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APPARATUS AND METHOD FOR INTERPOLATING A PIXEL FROM AN 
INTERMEDIATE LINE OF A FIELD 

BACKGROUND OF THE INVENTION 

5 The invention relates to the field of video signal processing, and in particular apparatus 

and method of interpolating a pixel from an intermediate line of a first field of a sequence of 
interlaced fields. 

Television signals normally contain information for temporally sequential fields that are 
displayed on a screen, wherein two successive fields are interlaced. That is, each field contains 
10 image information only in every other image line (i.e., where an image line for which image 
information is present in the one field is empty in the second field). 

FIG. 1 illustrates two such successive fields A and B in schematic form. The first field A 
includes image lines Al, A2, A3 and A4 for which a received video signal contains image 
information. The raster positions of fields A and B are mutually offset, such that the positions of 
15 the image lines from field B correspond exactly to the positions of the empty intermediate lines 
of field A, and vice versa. 

In order to enhance image quality, it is often desirable to generate frames for the display 
of a video signal containing a sequence of fields, that is, images in which no empty intermediate 
lines are present. 

20 The approach is proposed in European Patent 0192292 Bl for interpolating a pixel from 

an intermediate line of a field, wherein two pixels are selected from the field in which the pixel is 
to be interpolated. That is, one pixel of an image line above the pixel to be interpolated and one 
pixel of an image line below the pixel to be interpolated, with the horizontal positions of the 
selected pixels corresponding to the horizontal position of the pixel to be interpolated. In 
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addition, a pixel from an image line is selected from a temporally following field, and the 
vertical position of the selected image line corresponds to the position of the image line of the 
pixel to be interpolated. The horizontal position of the selected pixel corresponds to the 
horizontal position of the pixel to be interpolated. In the known method, the average of the 
5 image information values - usually the brightness values or luminance values - is determined for 
these three pixels, and for the pixel to be interpolated the image information of the pixel whose 
image information value comes the closest to the average so determined is selected. The pixel of 
the second field is, in other words, utilized for the interpolation when the image information 
value of this pixel lies between the image information values from the pixels of the field with the 

10 intermediate point to be interpolated. Otherwise, the image information of one of the pixels from 
the adjacent line of the pixel to be interpolated is selected, with the result that one of these values 
is doubled (i.e., displayed twice one below the other). However, this repetition of a pixel results 
in a positionally incorrect display in the case of pronounced vertical transitions, a result which is 
particularly evident in the image along diagonal edges. 

15 Therefore, there is a need for an improved technique of interpolating a pixel from an 

intermediate line of a field from a sequence of interlaced fields. 

SUMMARY OF THE INVENTION 

In a method of interpolating a pixel from an intermediate line of a field from a sequence 
20 of interlaced fields, provision is made to select at least one first pixel from an image line above 
the intermediate line in the first field, and at least one second pixel from an image line below the 
intermediate line in the first field, and to select from a second field at least one third pixel from 
an image line for which the vertical position corresponds to the position of the intermediate line 
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of the pixel to be interpolated, wherein the second field preferably temporally follows the first 
field. Subsequently, determination is made of an interval provided by image information values 
for the first and second pixels, and of the position of the image information value of the third 
pixel relative to the interval limits. The image information values for the first, second and third 
5 pixels are then mixed by multiplying the first image information value by a first weighting 
factor, the second information value by a second weighting factor, and the third image 
information value by a third weighting factor, then adding the weighted image information 
values, where the value of the third weighting factor is a function of the mathematical distance of 
the third information value from the closest interval limit. 

10 The third weighting factor preferably decreases with increasing distance from the closest 

interval limit when the third information value lies outside the interval provided by the first and 
second image information values. In analogous fashion, the third weighting factor increases with 
decreasing distance from the center of the interval when the third image information value lies 
within the interval. The increase or decrease of the weighting factor preferably being 

15 proportional to the reciprocal of the distance from the closest interval limit or from the center of 
the interval. 

The first and second weighting factors for the image information values of the first and 
second pixels are preferably of equal size. 

In one embodiment, provision is made to set the third weighting factor to zero if its 
20 mathematical distance from the closest interval limit of the interval provided by the image 
information values of the first and second pixels exceeds a limit normalized for the interval 
width. This limit corresponds in one embodiment to the interval width or to double the interval 
width. 
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If the third image information value lies within the interval, then provision is made in one 
embodiment to set the third weighting factor to one. In another embodiment, the third weighting 
factor is set to one when its mathematical distance from the center of the interval is smaller than 
a specified value normalized for the interval width, this limit preferably being less than one- 
5 fourth the interval width. 

In another embodiment, provision is made to select the first, second and third weighting 
factors to be of equal size for the case in which the third image information value lies within the 
specified interval. 

In one embodiment, mixing of the three image information values may be implemented 
10 in two steps, wherein the image information values of the first and second pixels are mixed in a 
first step, the image information values for example being weighted equally. The intermediate 
value obtained by mixing the first and second image information values is mixed with the third 
image information value in a second step, wherein the weighting factor of the third image 
information value is a function of its mathematical distance from the interval limits. For the 
15 weighting factor of the intermediate value during mixing in the second step, the applicable 
requirement is that this be the difference between 1 and the third weighting factor. 

In selecting the third weighting factor, the mathematical distance of the third pixel from 
the intermediate value is preferably also taken into account. 

These and other objects, features and advantages of the present invention will become 
20 more apparent in light of the following detailed description of preferred embodiments thereof, as 
illustrated in the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 provides schematic diagrams of two temporally successive fields; 
FIG. 2 is a graphic diagram of the position of selected image information values in a 
vertically plotted image information value scale; 
5 FIG. 3 is a block diagram illustration of a first embodiment of an interpolation device; 

FIG. 4 is a block diagram illustration of a second embodiment of an interpolation device; 
FIG. 5 is a block diagram illustration of a third embodiment of an interpolation device; 
FIG. 6 is a block diagram illustration of a fourth embodiment of an interpolation device; 
FIG. 7 is a block diagram illustration of a fifth embodiment of an interpolation device; 

10 and 

FIG. 8 is a plot of the upper limit of the third weighting factor as a function of the third 
image information value. 

DETAILED DESCRIPTION OF THE INVENTION 

15 A method for interpolating a pixel Px from an intermediate line of a field A shown 

schematically in FIG. 1 includes the selection of a first pixel P0 and second pixel P2 in field A in 
which pixel Px of the intermediate line is to be interpolated. The first pixel P0 lies in an image 
line A2 that lies above the intermediate line of the pixel to be interpolated Px, and the second 
pixel P2 lies in an image line A3 below the intermediate line with the pixel to be interpolated Px. 

20 The horizontal position of the first and second pixels P0, P2 corresponds to the horizontal 
position of pixel to be interpolated Px. In addition, a third pixel PI is selected from a field B that 
preferably temporally follows or precedes field A, the pixel originating in image line B2, the 
vertical position of which corresponds to the position of the intermediate line with the pixel to be 
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interpolated Px in field A. The horizontal position of the third pixel PI selected in second field 
B corresponds to the horizontal position of the pixel to be interpolated Px. 

An image information value, such as a brightness value or luminance value L0 5 LI, L2 is 
allocated to each of these pixels PO, PI, P2, respectively. These image information values LO, 
5 LI, L2 are plotted vertically in FIG. 2 on an image information value scale L, in which the image 
information values in the case of luminance values may, for example, assume values of between 
0 and 255. 

In the example chosen in FIG. 2, the image information values LO, LI, L2 are of differing 
size, with the image information value LI of the pixel PI lying outside an interval specified by 
10 the first image information value LO and the second image information value L2. 

The image information values of selected pixels P0, PI, P2 are each multiplied by a 
weighting factor K0, Kl, K2, and the resulting weighted image information values are added to 
generate an image information value Lx, which can be expressed: 

15 Lx = (K0 • LO) + (Kl • LI) + (K2 • L2) (1) 

The weighting factors K0, Kl, K2 are selected such that the image information value of the 
resulting pixel Lx lies within the interval specified by the first and second image information 
values LO, L2. The third weighting factor Kl is selected as a function of its mathematical 
20 distance from the interval limits. For example, in FIG. 2 the distance of the third image 
information value LI from the upper interval limit specified by the second image information 
value L2 is denoted by A. 
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The first image information value LO and the second image information value L2 are 
preferably of equal weight, where the expression applying to the image information value Lx of 
the pixel to be interpolated Px is: 

5 Lx = (1 - Kl) ■ (LO + 12)12 +K1 • LI. (2) 

The fraction of the image information value Lx resulting from the first pixel LO and the 
second pixel L2 corresponds to the average M shown in FIG. 2 of the image information values 
LO, L2, the average being multiplied by a weighting factor (1 - Kl), where the sum of all the 
10 weighting factors K0, Kl, K2 is always equal to 1 . 

In order to ensure in this case that the image information value Lx of the pixel to be 
interpolated Px lies within the interval specified by values LO and LI, and that the expression 
0 <K < 1 applies for the weighting factor, the following inequality must be fulfilled: 

15 | (1 - Kl) ■ M + Kl ■ LI - M | < | (LO - L2)/2 | (3) 

For the third weighting factor Kl, given the equal weighting of the first and second image 
information values LO, L2, the applicable expression is: 

20 Kl < | (LO - L2) | / 2 • | LI - M | (4) 

FIG. 8 is a plot of the upper limit of the third weighting factor Kl based on the above 
inequality, the third weighting factor in the graph of FIG. 8 being set at one when the third image 
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information value LI lies within the interval specified by image information values LO and L2. 
In other words, FIG. 8 shows: 

Kl = 1 for LI within [LO; LI] (5.1) 

5 Kl < | (LO - L2) | / 2 • | LI - M | for LI outside [LO; LI] (5.2) 

If the third weighting factor Kl is set equal to the value indicated in equation (5.2) when 
the third image information value LI is selected to lie outside the interval specified by the image 
information values LO and L2, then the resulting image information value Lx lies at the 
10 respective interval limit closest to the third image information value LI. If the third image 
information value LI lies within this interval, then the weighting factor may assume other values 
in addition to 1, as will be explained below. 

The third weighting factor Kl is preferably selected such that it is considerably smaller 
than the limit provided in equation (4) or equation (5.2), by employing, for example, the square 
15 of the right-hand expression of the equation (4) or of the equation (5.2) for the value of the third 
weighting factor Kl, or by squaring the denominator in the right-hand expression. 

If the image information values LO and L2 are not equally weighted, then Kl must be the 
applicable weighting factor so that the resulting pixel Lx lies at the interval limits, or within the 
interval between the upper interval limits [LI; L2]: 

20 

Kl < (M - (K0 • LO + K2 ■ L2) ± 0.5 • | (LO - L2) |) / LI (6) 
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A plus sign before the expression 0.5 • | (LO - L2) | causes the resulting image information value 
Lx to be greater than the average, and a minus sign before the expression causes the resulting 
image information value to be smaller than the average. 

The weighting factor Kl is preferably considerably smaller than the expression provided 
5 in the right-hand part of the equation (6). 

FIG. 3 a device for implementing the method according to an aspect of the invention, 
which device has a selection device 10 that receives the video signal S(t) and filters out the 
image information values LO, LI, L2 from this video signal and provides these signals on lines 
12-14, respectively. The image information values LO, LI, L2 are input to an analyzer 20 that 

10 generates weighting factors K0, Kl, K2 on lines 16-18, respectively, from the image information 
values LO, LI, L2. Mixer 30 supplies the image information value Lx on line 19 by weighting the 
first image information value L0 by the first weighting factor K0; the second image information 
value L2 by the second weighting factor K2, and the third image information value LI by the 
third weighting factor Kl, then adding the weighted image information values. 

15 FIG. 4 shows another embodiment of an interpolation device wherein the mixing is 

performed in two steps by this device. In this device, the image information values L0, LI, L2 on 
the lines 12-14 are fed to an analyzer 21. The first image information value L0 and the second 
image information value L2 are fed to a first mixer 33, which provides the intermediate image 
information value Lz on line 22. From the image information values L0, LI, L2, the analyzer 21 

20 generates weighting factor K01, which is fed to the first mixer 33, as well as a second mixing 
factor Kl 1 that is fed to a second mixer 32. The intermediate image information value Lz on the 
line 22 results from mixing the first image information value L0 and the second image 
information value L2, where weighting factor K01 indicates, for example, how strongly the first 
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image information value LO is weighted - namely, for the intermediate image information value 
Lz, the following expression applies: 

Lz-KOl -LG + (1 -K01)-L2 (7) 

5 

The weighting factor Kll is fed to the second mixer 32 and determines how strongly the third 
image information value LI is weighted. The image information value Lx output from the 
second mixer 32 can be expressed as: 

10 Lx = Kll -Ll+(1 -Kll)-Lz (8) 

where the image information values LO, L2 correspond to the average M when the weighting 
factor KOI =0.5. 

The weighting factor Kl 1 is generated such that the resulting image information value Lx 
15 lies within the interval limits specified by the image information values LO and L2. 

FIG. 5 shows a device which has been modified relative to that of FIG. 4 in which, in 
addition to the image information values LO, L2, the intermediate image information value Lz is 
also input to an analyzer 22 that generates weighting factors KOI and Kl 1. 

The generation of weighting factor KOI, which indicates the relative weighting of the 
20 first image information value LO and the second image information value L2 as a function of the 
image information values LO and L2, enables one of these two pixels to be more strongly 
weighted, for example as a function of the interval width. 
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FIG. 6 shows a device which has been modified relative to that of FIG. 5 in that 
weighting factor KOI is specified from an external source to be a constant (e.g.. 0.5), 
independent of the image information values L0 5 LI, L2. 

FIG. 7 shows a device, in which a second mixer 35 contains a switch 36 that outputs, as a 
5 function of the third weighting factor Kll, either the third image information value LI or the 
intermediate image information value Lz generated from the first and second image information 
values L0, L2 as the output signal Lx. 

The invention is not restricted to image processing. It may be generally applied to signals 
that include a signal sequence having output values and an interpolated intermediate value that is 
10 allocated to two output values. An example of such a signal sequence is a sequence produced by 
oversampling an output sequence in which one interpolated intermediate value each lies 
temporally or spatially between two output values. Known interpolation methods for this type of 
intermediate value generation often provide insufficient results, specifically undesirable 
overshoots, for signal jumps, that is, in the case of large amplitude differences for the two output 
15 values on which the interpolated intermediate value depends. 

This problem is remedied by application of the method outlined above to the signal 
sequence having output values and interpolated intermediate values, wherein one of the output 
values is processed based on the first image information value, the second of the output values is 
processed based on the second image information value, and the intermediate value that is a 
20 function of the first and second output values is processed based on the third image information 
value. The signal generated according to the invention provides a corrected interpolated 
intermediate value. 

Although the present invention has been shown and described with respect to several 
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preferred embodiments thereof, various changes, omissions and additions to the form and detail 
thereof, may be made therein, without departing from the spirit and scope of the invention. 
What is claimed is: 
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